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Abstract 


The purpose of this qualitative study was to examine the 7" grade reading performance among a 
random sample of urban public school academies (charter schools) in Wayne County, Michigan, 
compared with a random sample of traditional urban public schools within the same geographic 
area. This study was conducted using the fall 2012 Michigan Educational Assessment Program 
(MEAP) reading test scores, as reported by the Michigan Department of Education. A total of 11 
public charter schools were selected and represented 15% of the total public charters in Wayne 
County that serviced middle school aged children. The 11 randomly selected Traditional Public 
Schools used for the comparison represented 10% of these traditional public schools that were 
located within a 5-mile radius of the public charter schools. Contingency tables were constructed 
(type of school vs. reading proficiency) and the data was analyzed using the nonparametric chi- 
square test for independence. According to the data, the traditional public schools had a higher 
percentage of grade 7 students who were proficient readers when compared with the public char- 
ter schools (30.7% vs. 18.6%, respectively). The difference, however, was not statistically signifi- 
cant and the null hypothesis was not rejected. These results suggested that the public charter 
schools were not outperforming traditional public schools in grade 7 reading proficiency. 


Keywords 


Michigan, Reading, Charter Schools, Urban Education 


Subject Areas: Demography, Education 


1. Introduction 


Public School Academies (PSA), also referred to as public charter schools, are schools of choice that were 
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established with the intent to provide unique educational opportunities for students and communities. Unlike 
Traditional Public School (TPS) districts in Michigan, public charter schools are authorized by community col- 
leges, universities, intermediate and local school districts. Public charters are also permitted to be managed by 
for-profit entities. Pursuant to the Michigan Revised School (RSC), also known as Public Act 451 of 1976, a 
Public School Academy (PSA) is state-supported public school under the state constitution, operating under a 
charter contract issued by a public authorizing body according to Revised School Coded §380.502 (1) [1]. 

The first Michigan charter school legislation, Public Act 284, was passed in December 1993. Proponents of 
the legislation believed that public charters were a necessary reform in public education. Public charter schools 
serve as a model of accountability and infusion of market competition into public education, and responding to 
the needs of parents, students and communities [2]. This legislative Act culminated in the opening of the first 
nine public charter schools in 1994. For example, Aisha Shule and Casa Maria (later named Casa Richard 
Academy) were among the first Michigan public school charters to be established in Wayne County, Michigan 
[3]. Since then, there has been a steady increase in the number of Michigan public charter schools despite the 
closure of some failing academies including the aforementioned Casa Richard Academy which closed its doors 
in 2014. The Michigan Department of Education reported a total of N = 272 public charter districts in 2013 with 
40% of them located in Wayne County [4]. Furthermore, the Michigan Association of Public School Academies 
reported the addition of 34 new public charter schools and the closure of 12 in the fall of 2013, bringing the total 
number of public charter schools in Michigan to N = 298 [5]. 

The National Alliance for Public Charter Schools reported that ten public charter schools were terminated and 
closed down at the end of the 2011-2012 school year, while 33 new public charters opened in the fall of 2012 [6]. 
In the 2010-2011 school year, Michigan added 20 additional public charters and experienced the closure of three 
underperforming schools [7]. The proliferation of public charters in Michigan and the continuing closure of 
some has been a concern for public education advocates. Amber Arellano, the Executive Director of Education 
Trust-Midwest, asserted that charter school operators should be working on improving struggling schools before 
opening up new ones [8]. 

While public charter school management and governance may differ from that of a local district, they must 
abide by all Michigan legal requirements, state guidelines, and the Michigan School Code [1]. This includes the 
requirement to employ highly qualified teachers and staff, and to administer all state assessments, such as the 
Michigan Educational Assessment Program (MEAP) and Michigan Merit Exam (MME) at the appropriate grade 
levels [1]. The MEAP has been utilized to assess the academic performance of all public school students, in- 
cluding those in public charter schools in grades 3 - 9, while the MME is used to assess students’ academic per- 
formance in grade 11. The results of the MEAP and the MME tests are included in Michigan’s newly created 
Michigan School Accountability Scorecard [9]. The Scorecards, which replaced the Adequate Yearly Progress 
(AYP), combined student assessment data with attendance and graduation rates as well as compliance with state 
and federal laws. The five content areas include mathematics, reading, writing, science and social studies. All 
Michigan public schools are expected to reach 85% proficiency in all content areas by the 2021-2022 school 
year. The MEAP and MME results report students’ proficiency levels in each of the tested content areas. Stu- 
dents’ performance is rated at one of the following four levels: advanced (level I), proficient (level ID, partially 
proficient (level II) and not proficient (level IV). The goal is to have all students perform at or above the profi- 
cient level. 

The purpose of this study was to examine the performance of students in both public charters and traditional 
public schools in Wayne County on the 7 grade MEAP assessment in reading. In order to conduct the study, 
the following hypothesis was generated: 

H, (Null): Among grade 7 Wayne County students, there is no relationship between the type of public school 
and reading proficiency on the 7" grade MEAP reading assessment. 

Hy, (Alternative): Among grade 7 Wayne County students, there is a relationship between the type of public 
school and reading proficiency on the 7 grade MEAP reading assessment. 

This information can be useful for school teachers, administrators and parents who are concerned with educa- 
tional reform and school choice. School administrators and teachers—more specifically those in urban ar- 
eas—can use the results of this study to gain a greater understanding of the level of public charter schools per- 
formance and to examine challenges and opportunities that will improve achievement and ensure success for all 
students. In addition, the findings will be critical for the educational community in seeking a unified and coher- 
ent approach to address the needs of all students separate from the competitive and adversarial relation-ships 
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between the proponents of public charter schools and of traditional public schools. 

Furthermore, this study is important in other respects. The educational community has been continually re- 
minded that legislators and choice advocates who gave impetus to the creation of public school academies pro- 
moted them as a unique addition or an alternative to the public school system. Thus, this study will provide a 
critical and an analytical perspective for both opponents and proponents of the public charter movement to ex- 
amine the extent of adherence to the public charters’ unique mission and to explore collective measures based on 
sound pedagogical theory and best practices. 

Although the research is limited to 7" grade reading performance, the findings will call attention to further 
study of potential gaps in other subject areas and grade levels within urban schools. Additionally, the study 
could be replicated to examine similar variables in non-urban settings to discover any potential gaps and dispari- 
ties. The demographic realities in Wayne County bring another important factor that cannot be overlooked. 
Wayne County is the largest county in Michigan with the largest concentration of public charters in the state to- 
taling 40% of all Michigan charters. It is also a region with a higher concentration of poor and minority popula- 
tions than any other county in Michigan. The U.S. Census Bureau reported that 22.7% of the county’s popula- 
tion lives below the poverty line, while 44.3% are African-American [10]. The awareness of the performance 
trends within high minority communities is critical for educators and communities as they set out to plan im- 
provements and implement curricular and instructional measures to meet the needs of public charter school stu- 
dents. 


2. Background 


The charter school educational reform incorporated the principles of market economy in promoting competition, 
deregulation, and accountability. These principles have been based on the premise that market economy princi- 
ples will contribute to innovation and reform within the public school system [11]. Much of the support for this 
type of reform has also been premised on the theory that public charters will empower communities to develop 
and support their own schools [12]. The early proponents of charter public schools argued that these new models 
of schools would provide an opportunity for improved student achievement through unique programs, innova- 
tive teaching methods, enhanced accountability and autonomy, parental choice and effective utilization of re- 
sources [13]. The sustained efforts of charter school reformists were reinforced by the No Child Left Behind Act 
(NCLB) of 2001, which promoted charter schools as a public school alternative to and catalyst for the improve- 
ment of failing schools [14]. 

For the most part, Michigan’s public charter schools tend to attract minority students within segregated demo- 
graphic patterns. A two-year study showed that Michigan’s public charter schools enrolled a greater number of 
African American students and had more students who qualified for free or reduced lunch programs [15]. The 
Center for Educational Reform found that the majority of students who enroll in Michigan’s public school char- 
ters share several characteristics that include at-risk backgrounds, low socio-economic status and belonging to a 
minority group [16]. For example, Detroit’s public charter schools serve student populations that are almost 
100% at-risk, low income and minority. Studies suggested that public charter schools are most likely to be com- 
prised of a significant portion of the market share of public education within big cities with large African- 
American populations, such as New York, Detroit, St. Louis, Washington DC and New Orleans [17]. States with 
higher numbers of African-American and Hispanic students also have greater numbers of public charter schools 
[18]. In fact, a large number of public charter schools are located in hyper-segregated cities such as Detroit, 
where the majority population is African-American, and student enrollment that follows a predominantly segre- 
gated pattern due to inadequate accessibility to transportation outside the community [19]. Indeed, with limited 
transportation opportunities, students who are confined to segregated communities have limited mobility to at- 
tend a school beyond their immediate geographic area. 

Public charter school proponents argue that such high concentrations of minority enrollment within public 
charters is attributed to the high demand for educational choice and alternatives among minorities, whom they 
say have been traditionally underserved by the traditional school system [16]. A study conducted in 2010 by re- 
searchers at the University of Colorado-Boulder and Western Michigan University found that most public char- 
ter school were divided between either very segregated high-income schools, or very segregated low-income 
schools. The study also found that these public charters tended to enroll smaller numbers of special education 
students and English Language Learners [20]. 
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In addition to attracting primarily minority student populations, public charter schools also attract largely in- 
experienced teachers. According to data from Michigan’s Center for Educational Performance and Information 
(CEPI) for the 2011-2012 school year, 31% of teachers in Michigan’s public charter schools had less than one 
year of teaching experience, while 4% had over 11 years of teaching experience. In comparison, 3% percent of 
traditional public school teachers had less than one year of teaching experience, while 25 percent had more than 
11 years of teaching experience [21]. 

Why do some parents choose public charter schools? There are various reasons including safety, small class 
size, purported uniqueness, and perception of unmet needs within the traditional public school system. Parents 
who enroll their children in public charter schools believe that charters would be able to accommodate the needs 
of their children within a system where they have greater access to teachers and administrators than in traditional 
public schools [18]. Others enroll their children due to the potential benefit of safety and smaller class size [22]. 
In addition, there are some parents who believe that public charters provide curriculum content that is geared 
toward the individual needs of students to keep them more challenged [8]. 


3. Meeting the Expectations 


While proponents continue to believe in the viability of the public charter school system, the performance results 
of public charters have had mixed results. Since the inception of public charter schools nearly two decades ago, 
it can be argued that the research has overemphasized the comparisons with local district performance rather 
than with the state-wide performance levels. An analysis by the Michigan Association of Public School Acade- 
mies that used the 2011-2012 MEAP reading and math results for grades 3 - 8, found that African-American 
students in public charter schools scored higher than African-American students in traditional public schools 
within the same host districts [23]. 

The analysis also found that the largest gaps were in the MEAP reading scores. For example, 43.6% of Afri- 
can-American students in public charters were proficient in reading, compared to 34.3% of African-American 
students in traditional public schools. The performance gap in the MEAP reading scores were also large in De- 
troit, where 42.5% of public charter schools students were proficient, compared to 35.5% proficient among their 
counterparts in the Detroit Public Schools. In contrast, a similar analysis conducted by the Detroit News found 
that the majority of high school charters in Detroit underperformed their counterparts in the traditional public 
schools in all subject areas except social studies [24]. 

However, a recent study of MEAP and MME results found that while public charter schools test results were 
at or below statewide averages in Michigan, they had followed a similar pattern of achievement as that of tradi- 
tional public schools, for both the less-advantaged and better-off students [25]. On the other hand, other re- 
searchers pointed out the positive impact that public charter schools had on the achievement of low income and 
minority students. A study commissioned by the Boston Foundation highlighted the influence of well-run char- 
ters in meeting the needs of inner-city children. The Boston study relied on a comparison of the test scores of 
students who were actually admitted to public charters through the lottery system to the test scores of students 
who were entered into the lottery but were not selected. According to the results of the study, students who had 
won the admission lottery and enrolled in the public charter schools made greater gains in mathematics and 
English scores than students who had lost the admission lottery and remained in the traditional public school 
[26]. A more recent study by the Boston Foundation also found that public charter school students outperformed 
their peers in traditional public schools on standardized tests and 4-year college enrollment rates [27]. 

According to a national study which involved public school charters in 16 states, the Center for Research on 
Educational Outcomes (CREDO) found that 46% of public charter schools showed no significant difference in 
achievement when compared to their counterparts in the traditional public schools, while 37% of public charter 
schools performed below the achievement level of traditional public school counterparts, with 17% of public 
charter schools reporting academic gains that were significantly better than traditional public schools [28]. Sev- 
eral research studies found that public charter school students demonstrated achievement levels that were similar 
or lower than the achievement of traditional public school students [29]. A recent CREDO study released in 
2013 showed that slightly more than one-half of Detroit’s public charters were not significantly different in their 
student performance when compared to their traditional public school counterparts [30]. The same study found 
that Michigan’s public charter schools showed modest improvements since 2009, although some of the im- 
provements were attributed, in part, to the closure of poor performing public charters and the declining per- 
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formance of traditional public schools [30]. 


4. Methods 


This qualitative study consisted of using publicly available data results from the 7" grade reading component of 
the Michigan Educational Assessment Program (MEAP) for the fall 2012 test cycle (www.michigan.gov/meap). 
The MEAP is a criterion-referenced assessment which is comprised of five content areas: reading, writing, math, 
science and social studies for grades 3 - 8, and 9" grade social studies. While reading and math were adminis- 
tered in all grades, the other subjects varied by grade. The Michigan Department of Education required all public 
school to administer the MEAP and insure 95% student participation rate. Specifically, this secondary data 
analysis used reading proficiency results from a random selection of Wayne County, Michigan traditional public 
schools and public charter schools. The publicly available data sets were downloaded from the Michigan De- 
partment of Education’s web site and were then abstracted. There were a total of n = 11 (15%) public charter 
schools that educated grade 7 students, and n = 11 traditional public schools (10%) that were located within a 
5-mile radius of the public charter schools’ zip code, and also provided education for grade 7 students. The iden- 
tification of traditional public schools was conducted through a web-based search on www.greatschools.org, 
where the distance parameter was set at a 5-mile radius from the public charter school zip code [31]. The public 
charter schools were selected from the 2011-2012 Wayne County School Directory [32]. The random samples 
were generated using the random number generator available in SPSS [33]. The sampling plan excluded magnet 
schools and any school with a special population, such as strict discipline academies, residential treatment cen- 
ters and youth detention facilities. Additionally, the sampling of traditional public schools excluded all schools 
that have been transformed into charter academies, and those that were transferred to the jurisdiction of the 
Education Achievement Authority (EAA) and private management companies. Table 1 includes the charter 
public schools sample and the associated reading proficiency levels on the grade 7 MEAP (see Table 1). The 
sample of traditional of public schools is represented within Table 2 (see Table 2). 

In order to carry out the analysis, a 2 x 2 contingency table was constructed in SPSS and consisted of the type 
of school (TPS/PSA) compared to grade 7 MEAP reading proficiency (yes/no). The reading proficient category 
included students who had performed at the advanced level (level I) and the proficient level (level II). The 
non-proficient category included students who performed at the partially proficient level (level III) and the not 
proficient level (level IV). The nonparametric chi-square test for independence was performed. Chi-square is 
well suited for analyzing contingency tables that employ nominal variables and is rather flexible because 


Table 1. Performance summary on 7" grade reading MEAP of selected charters (Fall 2012). 


5 
PublieSehool ACAEDY  Tyatrestedsnadents PEEEMECDPMOLENE yon proce 2012 
(Levels 3 & 4) 

PSA—A 81 93.8% 6.2% 
PSA—B 192 24% 76% 
PSA—C 248 35.5% 64.5% 
PSA—D 43 81.4% 18.6% 
PSA—E 100 25% 75% 
PSA—F 47 23.4% 76.6% 
PSA—G 130 35.4% 64.6% 
PSA—H 115 56.5% 43.5% 
PSA—I 140 47.1% 52.9% 
PSA—J 79 38% 62% 
PSA—K 41 65.9% 34.1% 


Note. Source: Michigan department of education (2013). 
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Table 2. Performance summary on 7" grade reading MEAP of selected traditional public 


schools (Fall 2012). 
choo! (TPS) Teta tested students ee ct gon proficient 2012 
TPS—A 65 27.7% 72.3% 
TPS—B 294 70.4% 29.6% 
TPS—C 155 48.4% 51.6% 
TPS—D 38 28.9% 71.1% 
TPS—E 37 24.3% 75.7% 
TPS—F 235 48.5% 51.5% 
TPS—G 355 60.3% 39.7% 
TPS—H 249 67.5% 32.5% 
TPS—I 197 58.9% 41.1% 
TPS—J 28 57.1% 42.9% 
TPS—K 252 61.5% 38.5% 


Note. Source: Michigan department of education (2013). 


chi-square is distribution-free [34]. The significance level was set at an alpha level of 0.05 with 1 degree of 
freedom. 


5. Results and Analysis 


According to the data, traditional public schools had a higher reading proficiency rate than the public charter 
schools (30.7% vs. 18.6%), however, the results were not statistically significant, Pearson X° (1, N = 3121) = 
1.87, p = 0.172. Therefore, we failed to reject the null hypothesis (see Table 3 & Table 4). The results also 
suggest that the student performance on the grade 7 MEAP reading section for the random sample of Wayne 
County public charter school students were similar to the performance of the random sample of traditional pub- 
lic school students. 


6. Conclusion 


This study found no significant difference in grade 7 reading proficiency when public charter schools were 
compared to traditional public schools. These findings run contrary to various multi-media marketing campaigns 
that are commonplace in Wayne County. This would include those public charter schools that purport to be 
“college ready”, “innovative”, and “unique” to name a few. There are several limitations associated with this 
study. The limitations include a small sampling plan, the restriction to only one content area, as well as the lack 
of experimental control, i.e., the inability to randomize students to the type of public school setting. In addition, 
one is refrained from making statements of generalizability, while taking into account that public charter schools 
draw upon enrollment beyond the geographic boundaries of the residential public school district. Future re- 
searchers should consider employing a larger sampling plan that utilizes multiple settings, including rural areas 
as well as various socio-economic demographics. Nevertheless, publicly available data permits one to test vari- 
ous research hypotheses in a rather efficient and cost-effective manner. The authors had assumed a gap in profi- 
ciency based on their close working relationships with various Wayne County public charter schools, as well as 
an intimate knowledge of their curriculum and their MEAP proficiency trends. Significant research studies 
found public charter schools to underperform when compared to their traditional public school counterparts, or 
at best, to perform within the same performance level [35]. 

In addition, the results of this study provide an opportunity for charter school advocates to examine the condi- 
tions that have hampered their ability to translate the charter schools’ uniqueness and innovation into better stu- 
dent results. It remains unclear why the public charter schools academic outcomes were not significantly better 
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Table 3. School type * grade 7 fall 2012 reading status cross-tabulation. 


Grade 7 reading status 


School type Total 
Proficient Not proficient 
Student Count 958 947 1905 
Expected Count 939.4 965.6 1905.0 
Traditional Public School (TPS) % within School Type 50.3% 49.7% 100.0% 
% within Grade 7 Reading Status 62.2% 59.9% 61.0% 
% of Total 30.7% 30.3% 61.0% 
Student Count 581 635 1216 
Expected Count 599.6 616.4 1216.0 
Public School Academy (PSA) % within School Type 47.8% 52.2% 100.0% 
% within Grade 7 Reading Status 37.8% 40.1% 39.0% 
% of Total 18.6% 20.3% 39.0% 
Student Count 1539 1582 3121 
Expected Count 1539.0 1582.0 3121.0 
Total % within School Type 49.3% 50.7% 100.0% 
% within Grade 7 Reading Status 100.0% 100.0% 100.0% 
% of Total 49.3% 50.7% 100.0% 
Table 4. Chi-square test. 
vale af “Qesided) = Qasided) ((-sided) 
Pearson Chi-Square 1.869° 1 0.172 
Continuity Correction? 1.770 1 0.183 
Likelihood Ratio 1.870 1 0.171 
Fisher’s Exact Test 0.175 0.092 
Linear-by-Linear Association 1.869 1 0.172 
N of Valid Cases 3121 


Notes: °0 cells (0.0%) have expected count less than 5. The minimum expected count is 599.62; "Computed only for a 2 2 table. 


than their traditional public school counterparts, especially when both were located in the same geographic loca- 
tion. 

A few years before public charter schools were catapulted into the arena of school reform in Michigan, Lee 
Shulman of Stanford University argued the case for pedagogical reform. In his 1987 essay in the Harvard Edu- 
cational Review, he discussed what he thought to be a sound pedagogical foundation for educational reform. He 
argued that reform must be based on deep knowledge, pedagogical reasoning, transformation, and reflection [36]. 
The efficacy of pedagogical reform has been reinforced by recent research on high performing public charter 
schools. In a study of five high performing public charter schools, researchers found that all of the schools in 
their study shared several successful practices and strategies that included a primary focus on the individual stu- 
dent and teacher [37]. At the heart of these strategies were various reading programs implemented during the 
course of the school day, attention to individual needs, encouragement of collegial reflection, emphasis on 
teaching higher order thinking skills, emphasis on outcomes, recruitment of high quality teachers, pedagogical 
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freedom, focus on maximizing instructional time, teacher training, and mentoring. Other studies showed that 
successful urban schools tend to share a core of characteristics that include: a strong and pervasive mission, 
ethical standards that align with the mission, focus on staff quality, best practices based on deep differentiation, 
engagement with all stakeholders, and personalized relationships [38]. Perhaps, it is time to revisit these ideas! 
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